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, We examine the notion of Haldane's dimension and the corresponding statis- 

(N ■ 

, tics in a probabilistic spirit. Motivated by the example of dimensional- 

o . 

regularization we define the dimension of a space as the trace of a diagonal 



'unit operator', where the diagonal matrix elements are not, in general, unity 



Qh! but are probabilities to place the system into a given state. These probabilities 



are uniquely defined by the rules of Haldane's statistics. We calculate the sec- 



ond virial coefficient for our system and demonstrate agreement with Murthy 

H : 

and Shankar's calculation. The partition function for an ideal gas of the par- 
ticles, a state-counting procedure, the entropy and a distribution function for 
the particles are investigated using our probabilistic definition. We compare 



our results with previous calculations of exclusion statistics, hep-th/9503233 
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There has been considerable recent interest in a paper by Haldane QXJ] generalising the 
Pauli exclusion principle and introducing a combinatorial expression for the entropy of par- 
ticles which were generalisations of bosons and fermions. Haldane initially defines a quantity 
d(N), which we will term the Haldane dimension, which is the dimension of the one-particle 
Hilbert space associated with the iV-th particle, keeping the coordinates of the other N — 1 
particles fixed. The statistical parameter, g, of a particle (or 'g-on') is defined by (where we 
add m particles) 

d(N + m) - d(N) 

9 = 1 

m 

and the conditions of homogeneity on N and m are imposed. In addition the system is 
confined to a finite region where the number K of independent single-particle states is finite 
and fixed. Here the usual Bose and Fermi ideal gases have g = for Bose case (i.e. d(N) 
does not depend on N) and g = 1 for Fermi case - that is the dimension is reduced by one 
for each added fermion, which is the usual Pauli principle. 

Haldane also introduced a combinatorial expression (which we denote the Haldane- Wu 
counting procedure) for the number of ways, W, to place N g-ons into K single-particle 
states. Then 



which was subsequently used by many authors to describe thermodynamical properties 
of g-ons. In particular Bernard and Wu |4| and Murthy and Shankar || showed that the 
behaviour of the excitations in the Calogero-Sutherland model is consistent with Eqn. (0) 
for g-ons, with fractional g, in general. 

In this Letter we argue that these two ideas introduced by Haldane are distinct, in that the 
most natural combinatorial expression for W, using the quantity d(N), is not (|2|). This leads 
us to a definition of the dimension of a Hilbert space which is fractional and is related in a 
natural manner to particles having a fractional g. We construct the statistical mechanics for 
such particles and show that many features agree with Wu's statistical mechanics, however 
the agreement is not complete. 



The argument for the expression for W in @ is illuminated by initially remembering 
the fermionic case, writing (|2]) in the form 

W F = K(K - 1) • • • (K - N + l)/N\ (3) 

where the ith bracket in the numerator is the number of possibilities to insert the zth particle 
in the system when all particles are distinguishable and then correcting the answer with N\ 
in the denominator. By analogy, expression (||D can be rewritten replacing the factor of 
the initial number of available states, K, in fermionic expression by an effective number of 
allowed states, K + (1 — g)(N — 1). Thus the space of available single-particle states swells 
before the particles are added. This contradicts the assumption of fixing the size of the 
system which leads to a fixed number of single-particle states. From the definition of the 
Haldane dimension, d(N), we would have naively expected a result of the form 

W = K(K - g) ■ ■ ■ (K + (1 - g)(N - 1) - N+ 1)/N\ (4) 

where the number of available states decreases proportionally to g as the particles are added. 
This expression has the drawback that it does not yield the Bose limit as g — > 0, although 
is correct for integer g > 1. 

It is very striking to compare the prediction of (^|) for the case g = 2 and straightforward 
calculation for K single-particle states and iV-particle sector. For example with K = 10 
and N = 3 Haldane- Wu procedure gives W = 8!/(3!5!) = 56 and Eqn. (|J) gives W = 
(10 • 8 • 6)/3! = 80 and the difference is observable. It is easy to see that, for general large 
K and N, the following expansion for the deviation of In W from straightforward counting 
exists: 

IN 2 ( N 3 \ 

lnW -lnW=-— + 0^— J . (5) 

This deviation is important for cases where the occupation numbers are not small. The 
above discussion may be summarised by stating that Haldane's definition of the fractional 
dimension and the Haldane- Wu state-counting procedure are not consistent. 
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We will now derive a W which is more in keeping with the notion of the Haldane dimen- 
sion. We will initially derive the result using one single particle state and then generalise to 
the case with many states. The basis is a probabilistic interpretation of a fractional Haldane 
dimension, and its implementation as a fractional-dimension Hilbert space. Probability en- 
ters since an attempt to add a particles to a particular single-particle state succeeds only 
with a certain probability. 

Consider the single-particle state to be initially empty. We assume that the statistics 
only start to enter at the two-particle level, so the probability of adding the first particle 
is unity: pi — 1. However the next particle may only be added with probability p 2 - Then 
if we consider a large number, M, of copies of our system and perform the trials with 
each of them we find approximately p 2 M doubly-occupied states so that on average only a 
fraction p 2 of the particle is on each site. We interpret this as the fractional dimension of the 
subspace associated with double occupation on the site and define the Haldane dimension 
to be d(2) = p 2 . In general we have that p^ is the probability of adding the iVth particle, 
given that there are already N — 1 particles there (i.e. the probability is conditional), and 
Pn = d(N). From this we may deduce the relation of p n to g using (TJ): 

d(N) = p n = l- (n-l)g n>l (6) 

In this context the original Pauli principle 'There are no double-occupied states' can be 
reformulated as 'The probability to construct a double-occupied state is equal to zero'. We 
should note that if g = 1/m, then there are no difficulties with negative probabilities (as 



Pm+i vanishes), and we shall restrict ourselves to those cases |10[ . 

The geometric implementation of this is by analogy with dimensional-regularization 
where the dimension of a space is defined as the trace of a diagonal 'unit operator' (or 
weight) where the diagonal matrix elements are not unity in general but are probabilities 
to find a system in the state corresponding to the matrix element. With this definition we 
may relate the probabilities used to relate the Haldane definition to the diagonal weights, 
q jy , since the probability of sequentially adding N particles to the vacuum is 



N N 

q N = T[Pn= Hi 1 -["-%) • (?) 

n=l n=l 

Then the dimension (not the Haldane dimension, as it is not a conditional probability) 
associated with the iV-particle subspace is q^, and the total dimension of the many-particle 
Hilbert space is the sum Y^^LqQn, with the convention that q = 1. The weight, X, is: 

J = diag(g ,gi,?2---) (8) 
and in the many single-particle state case 

oo 

j(*0 _ a nit ... tnK \n 1 ,---,n K )(n K ,---,n 1 \ . (9) 

ni,---,njf=0 

where is the number of states. We may now define the partition function, and hence 
thermal expectation values, of an arbitrary physical variable O: 

Z = Tr (1^ e~ pH ) or (6) = Tr (jW e^ H 6) (10) 

where the Hamiltonian H is H = Y^f=i e i n i by analogy with a bose or fermi ideal gas and 
is independent of statistics. It is the weight, TS K \ which completely defines the exclusion 
statistics of the particles. In Eqn. (§) |m, • • • , tik) is the state with m particles in the first 
single-particle state, n 2 at the second and so on and a ni) ... ;nic is the probability to find this 
state. It is obvious that the expression (|T0D gives right answers for fermions (ct ni ,--,n K — 1 for 
ni& • • • Szuk < 1 and zero otherwise) and bosons (ct nu ... tn , K = 1 for any m, ■ ■ ■ , %) and there 
is no contradiction in using this expression for statistics of an intermediate nature. Moreover 
we can say that Hilbert space of the theory is constructed if we define the operator and 
use the equalities (0). The mathematical details will be discussed elsewhere. 

We can now interpret a nu ...^ nK as the dimension of the subspace spanned by the vector 
l^i, • • • ,%). Indeed, usually dimension of a subspace S can be defined as a trace of unit 
operator on the subspace 

dimS = Tr(J w | 5 ) (11) 
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and by analogy with the definition in dimensional regularization, where d — e = The 
full dimension of the iV-particle subspace of the space of states is then given by the formula: 

W = Tr(lW\ ni+ ... +nK=N ) (12) 

which we will use presently for the state-counting procedure. Then Haldane's dimension 
d(N) of iV-th particle subspace with arbitrary fixed iV — 1-particle substate |n 1; • • • , nic),nx + 
• • • + rix = N — 1 is described then by relation: 

d(N) = £ ani '-' n ' +1 '-' n ^ Wl+ ... +Wy ,^ 1 . (13) 

1=1 ^ni,---,npc 

Let us turn to the concrete choice of the probabilities a ni} ... )TlI( and relate the result for one 
single-particle state, (|S|), to the many state case. Although the presence of many indices 
on the a's might indicate considerable choice, in fact there is a single self-consistent way to 
define cx nit ... >nK such that the definition of the iV-th particle dimension d(N) ( O ) actually 
gives the Haldane's conjecture K — g(N — 1) for d(N) and the Hilbert space of the system 
with K degrees of freedom is factorized as a product of Hilbert spaces corresponding to 
each degree of freedom (this property together with the Hamiltonian of an ideal gas of the 
particles will lead to the factorisation of the partition function and other physical quantities). 

To show this we will use of the assumption about the tensor product nature of the full 
Hilbert space, which immediately gives the operator TS K ' for the full system as a tensor 
product of the operators {Xi]f =l for each state: 

=Z 1 ®2 2 ® ■■■®X K . (14) 

The last relation is equivalent, using Eqn. (0) to the following expression for probabilities 

K 

<Xn u ~.,*K = II {(! - 9)0- ~2g) ■■■{!- (m - l)g)} . (15) 

i=i 

This leads, using (0), to the required equality for d(N): 

k 

d(N) = J2(l-gn l ) = K-gN . (16) 
i=i 
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One of the main advances of the paper || was the generalisation of the Haldane's definition, 
which originally was formulated for a finite-dimensional systems, to the case of an infinite- 
dimensional Hilbert space. Then the following expression for the statistical parameter g was 
obtained: 



1 K 
g = hm 



W 

N\ 



(17) 



2 * K->oo N(N - 1) 

and W is given by eq.(@). Now, replacing the original W by the 'regulated definition of the 
dimension of the Hilbert space' W = lim^o Zn = lim^o Tr (e~P N ) and substituting it 
into the eq. (|l7D the following generalisation of the Haldane's definition was proposed: 



1 .. z x 
g = lim 



iV!%-l 



(18) 



2 * /3->o N(N - 1) 

This definition fllSj) was used in the paper [§] to connect g-ons with anyons and excitations in 



the Luttinger model [|ll|] . However there is a very strong assumption here that it is possible 
to calculate the original fractional dimension, W, as a trace of the statistical operator. 
Thus the results of the paper |Q correspond rather to the systems which can be described 
via traces ( |T2"D rather than the original (those defined in Eqn. ([I])) g-ons. Our paper is an 
attempt to fill this breach and describe the original g-ons in terms of traces: we have already 
shown that our fractional Hilbert space definition agrees with Haldane's expression for N-th 
particle dimension d(N) (|T6|) . On the other hand we have shown that our definitions lead 
to the correct results if we use the formula ( ]I8D (so probabilistic g-ons are g-ons in the 
definition of Murthy and Shankar 0). 

More precisely it is possible to check that Wq contains exactly the same contributions 
proportional to (1 — g) n as W up to order 0(N n+1 /K n+1 ), providing the same description 
of double-occupied states (in particular this is reflected in the identity of the second virial 
coefficients B 2 — |(g — ■=)). So we can conclude that the behaviour of the systems at 
sufficiently low density (high enough, however, that statistical corrections begin play the 
role) governed by the state-counting dimension (g) and ( |T2"D are equivalent. Unfortunately 
we cannot to say the same about high order corrections. 



The factorisation of the statistical operator (|14]) implies a factorisation of the partition 
function of the system: Z = n£i %i > where the function Zj is the partition function of the 
single state with index i: Z{ = Tr (zj ■ e~^ ei ~^ ni ) . For the case of g = 1/m last expression 
can be expanded as 

Zi = Y, mC n n\ — . (19) 

m 

It is obvious that the formula (and hence all statistical quantities) interpolates between the 
Fermi (g = m = 1) and Bose (g = 0,m = oo) cases. 

The distribution function n(/3,fi) = (N/K) (where all single-particle states have energy 
e) may be calculated to be: 

s _ En=i m C n (n\n/m n ) e~ n ^ 
1 } En=o mC n (n\/m n ) e-^^-M) ' 1 J 

Statistical effects manifest themselves at low temperatures; in the low temperature limit, 
using (|20"D, the function n(/3, fj,) for our g-ons behaves analogously to Wu's distribution 
function [0]. At low enough, but finite, temperatures and energy, e, above the Fermi level 
(i.e. £ = e^ - ^ is very big and m > 2) we find the following expansion for the distribution 
function n(/5,/i) = (1/£)(1 + [m — 2]/[£m] + •••). Above the Fermi level the behaviour of 
the distribution function ( p0|) and Wu's is similar (this similarity has the same origin as the 
coincidence of second virial coefficients). 

The situation crucially changes if we consider the behaviour of the distribution functions 
below the Fermi level at low but finite temperatures (i.e. £ is a small but finite parameter). 
From Wu's calculations we immediately obtain the following approximate form for the dis- 
tribution: n(/3,fi) = 1/m — £ m + • • •. In contrast with this the asymptotics for distribution 
function (p0|) contains terms linear in £ : n(/3,fi) = 1/m — £/m + • • -. So our distribu- 
tion function has distinct behaviour compared to Wu's below the Fermi level; however the 
behaviour of our result may be more realistic. 

Now let us return to the state-counting procedure for probabilistic g-ons. For convenience 
we once more put all energies e« = e and we rewrite the formulae for the dimension of N- 
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particle subspace of the full Hilbert space (0) in the form without constrained summation 
which then can be treated SIS db Fourier integral: 



Last equality and the factorisation property flTo] ) for the coefficients a ni) ... jnK allow us to 
perform the summation on n\, • ■ • , rix and obtain the expression for Wq with only a single 
integral on the auxiliary variable 0: 



where the function z(e l< ^) coincides with the single state partition function on imaginary 
energy and chemical potential (P(fi — e) — > i<f>). The eq. (p2|) substitutes in the theory of 
probabilistic g-ons the state-counting Haldane-Wu expression (0). 

Wu and Bernard [|J state that systems which can be solved by the Thermo dynamical 
Bethe ansatz (TBA) can be considered as systems of ideal gas of the particles obeying 
Haldane's exclusion statistics. Let us stress again that these systems do not obey Haldane's 
exclusion statistics formulated in the terms of the iV-th particle dimension (in contradiction 
to previous work) but indeed are described by Haldane-Wu state-counting procedure with 
the formula (0). Following [|J we have a fermionic rule for the calculation, but the number 
of places available for occupation in the 'system' ('cell') depends linearly on the number 
of particles in the system. Nevertheless, the procedure differs from Haldane's definition. 
Indeed, unused ('free') places cannot be occupied by additional particles because they change 
in the next (N+l) particle sector. This can be observed, for example, in the Calogero model: 
in the iV-particle sector we can construct a motif using the notions of pseudo-particles and 
holes (for the connection with exclusion statistics see ||). These holes represent accessible 
orbitals but they cannot be filled by the N + 1-th particle as is required by Haldane's 
definition. This is not the only point of difference: the procedures are different, as discussed 
at the begining of this Letter. 

In conclusion, in this Letter we treated the notion of Haldane's dimension and the cor- 
responding statistics in a probabilistic spirit, defining the dimension of a space as the trace 






(22) 
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of a diagonal 'unit operator' where the matrix elements are the probabilities to place the 
system in a given state. (The probabilities are uniquely defined by the rules of Haldane's 
statistics.) The Hilbert space for particles with exclusion statistics was defined using this 
'unit operator', allowing the construction of a second quantised formulation of the theory 
I3| . Contrary to statements in earlier works, systems solvable by TBA are not an ideal gas 



of exclusion statistical particles but are described by a different deformation of statistics, 
based on the Haldane-Wu state-counting procedure. 

We wish to thank A.S.Stepanenko and I.V.Lerner for useful discussions. We thank the 
UK EPSRC for support under Grant number GR/J35221. This work was also partially 
supported (K.N.I) by the International Science Foundation, Grant N R4T000, the Russian 
Fund of Fundamental Investigations, Grant N 94-02-03712, INTAS-939 and Euler stipend 
of German Mathematical Society. 

Addendum: After this work was finished we saw reference ||15|| , where the author 
examined the microscopic origin of the Haldane-Wu state counting procedure, similarly 
to this work the notion of statistics was considered in a probabilistic manner. He assumed 
that a single level may be occupied by any number of particles, and each occupancy is 
associated with an a priori probability. These probabilities are determined by enforcing 
consistency with the state counting procedure. However the distinctions with this work are: 
no use was made of the definition of the Haldane dimension, there was no construction of a 
Hilbert space and the a proiri probabilities may be negative. As we noted above the Haldane 
dimension and the Haldane-Wu state counting procedures are distinct; the foundations of 



this work and reference [151 are distinct in the same manner. 
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